United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
I nilid Stall-, l'atint and Track-mark Office 

Address: COMMISSIONER FOR PATENTS 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. CONFIRMATION NO. 



I 0/5K03 1 9 



07/14/2000 



26339 7590 11/09/2010 

MUIRHEAD AND SATURNELLI, LLC 
200 FRIBERG PARKWAY, SUITE 1001 
WESTBOROUGH, MA 01581 



HICKS, CHARLES V 



PAPER NUMBER 



DELIVERY MODE 



Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



l/ffflrC? nVrliUli Otfff Iff ids y 


Application No. 

10/586,319 


Applicant(s) 

INOUE, MIKIO 


Examiner 

CHARLES HICKS 


Art Unit 

2629 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )KI Responsive to communication(s) filed on 23 August 201 0 . 
2a )□ This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 4,6,7,12,13 and 15-22 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) |EI Claim(s) 4. 6-7. 12-13. 15-22 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10) ^ The drawing(s) filed on 14 July 2006 is/are: a)^ accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) ^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)|EI All b)D Some * c)D None of: 

1 Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.Q Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO/SB/08) 5 ) □ Notice of Informal Patent Application 

Paper No(s)/Mail Date . 6) □ Other: . 

'TOL-326 (Rev. 08-06) Office Action Summary Part of Paper No./Mail Date 20101 104 



Application/Control Number: 10/586,319 Page 2 

Art Unit: 2629 

DETAILED ACTION 

This communication is responsive to the Request for Continued Examination filed 
08/23/2010. Claims 4, 6, 7 and 15 are amended. Claims 19-22 are new. Claims 4, 6- 
7, 12-13 and 15-22 are pending. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 4, 6, 7, 15 and 18-22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rafii et al. (6,614,422) in view of Fong et al. (US 2005/0012721) and 
further in view of Kloba (US 7,263,547). 

In reference to claim 4, Rafii teaches a mobile communication terminal (Rafii, Fig. 
1A, 80), comprising: 

image projection means for projecting a selected one of a plurality of predefined 
operation-plane images that displays virtually an operation-plane of an operation device 
operated by users (Rafii, Fig. 1A, 145; col. 4, II. 27-33); 

operation detection means for detecting operation on the selected operation- 
plane image projected by the image projection means (Rafii, Fig. 1A, 20; col. 10, II. 27- 
34); 
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data processing means for performing a predetermined data process based on 
the detection result of operation detected by the operation detection means (Rafii, Fig. 
3; col. 7, II. 16-18); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
designated recognition function corresponding to the selected predefined operation- 
plane image (Rafii, Fig. 1A.145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

wherein the image projection means projects the selected predefined operation- 
plane image corresponding to the designated recognition function designated by the 
designation information received from the application execution management means, 
from among the plurality of predefined operation-plane images (Rafii, col. 4, II. 27-33; 
projection of a grid or image); 

and wherein the operation detection means has a plurality of kinds of mutually 
different recognition functions to recognize operation content by at least one of position, 
direction and movement of an operation object on the plurality of predefined operation- 
plane images (Rafii, col. 12, II. 33-47), 

and detects operation on the selected operation-plane image by using the 
designated recognition function designated from among the plurality of mutually 
different recognition functions by the designation information received from the 
application execution management means (Rafii, col. 10, II. 27-34). 
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Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 

Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
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management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41; col. 7, II. 5-9; col. 11, II. 15- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1 , II. 36-39). 

In reference to claim 6, Rafii teaches a mobile communication terminal (Rafii, Fig. 
1A, 80), comprising: 

image projection means for projecting a selected one of a plurality of predefined 
operation-plane images that displays virtually an operation-plane of an operation device 
operated by users (Rafii, Fig. 1A, 145; col. 4, II. 27-33); 

operation detection means for detecting operation on the selected operation- 
plane image projected by the image projection means (Rafii, Fig. 1A, 20; col. 10, II. 27- 
34); 
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data processing means for performing a predetermined data process based on 
the detection result of operation detected by the operation detection means (Fig. 3; col. 
7, II. 16-18); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
recognition function corresponding to the selected predefined operation-plane image 
(Rafii, Fig. 1A.145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

wherein the image projection means projects the selected predefined operation- 
plane image corresponding to the designated recognition function designated by the 
designation information received from an application execution management means, 
from among the plurality of predefined operation-plane images (Rafii, col. 4, II. 27-33; 
projection of a grid or image); 

and wherein the operation detection means has a plurality of kinds of mutually 
different recognition functions to recognize operation content by at least one of position, 
direction and movement of an operation object on the plurality of predefined operation- 
plane images (Rafii, col. 12, II. 33-47), 

and detects operation on the selected operation-plane image by using the 
designated recognition function corresponding to the selected operation-plane image, 
the designated recognition function being designated from among the plurality of 
mutually different recognition functions by the designation information received from the 
application execution management means (Rafii, col. 10, 1. 27-34). 
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Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 

Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
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management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41; col. 7, II. 5-9; col. 11, II. 15- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1 , II. 36-39). 

In reference to claim 7, Rafii teaches a mobile communication terminal (Rafii Fig. 
1A, 80), comprising: 

image projection means for projecting a selected one of a plurality of predefined 
operation-plane image that displays virtually an operation-plane of an operation device 
operated by users (Rafii, Fig. 1A, 145; col. 4, II. 27-33); 

operation detection means for detecting operation on the operation-plane image 
projected by the image projection means (Rafii, Fig. 1A, 20; col. 10, II. 27-34); 
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data processing means for performing a predetermined data process based on 
the detection result of operation detected by the operation detection means (Fig. 3; col. 
7, II. 16-18); 

memory means for storing a plurality of image data corresponding to each one of 
the plurality of predefined operation-plane images (Rafii, col. 12, II. 48-53); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
recognition function corresponding to the selected predefined operation-plane image 
(Rafii, Fig. 1A.145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

and instruction generation means for generating an operation-plane image 
selection instruction in accordance with the content of the selected application program 
(Fig. 3; col. 7, II. 16-18); 

wherein the image projection means selects an image data from the plurality of 
image data memorized in the memory based on the operation-plane image selection 
instruction generated by the instruction generation means, and projects the operation- 
plane image of the selected image data (Rafii, col. 4, II. 27-33; projection of a grid or 
image); 

and wherein the application execution management means performs a data 
process corresponding to operation detected by the operation detection means in 
accordance with the content of the application program during execution of the selected 
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application program and in accordance with the designation information that designates 
the designated recognition function (Rafii, col. 10, II. 27-34). 

Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 
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Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41; col. 7, II. 5-9; col. 11, II. 15- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1 , II. 36-39). 

In reference to claim 15, Rafii teaches a mobile communication terminal (Rafii, 
Fig. 1A, 80), comprising: 

an image projector that projects a selected one of a plurality of predefined 
operation-plane images that displays virtually an operation-plane of an operation device 
(Rafii, Fig. 1A, 145; col. 4, II. 27-33); 
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an operation detector that detects operation on the selected operation-plane 
image projected by the image projector (Rafii, Fig. 1A, 20; col. 10, II. 27-34); 

a data processor that performs a predetermined data process based on the 
detection result of operation detected by the operation detector (Rafii, Fig. 3; col. 7, II. 
16-18); 

wherein an application execution management means selects the selected one 
of the plurality of predefined operation-plane images for projection according to content 
of an application program and generates designation information that designates a 
designated recognition function corresponding to the selected predefined operation- 
plane image (Rafii, Fig. 1A.145; col. 4, II. 27-33; Fig. 1A, 20; col. 10, II. 27-34); 

wherein the image projector projects the selected operation-plane image 
corresponding to the designated recognition function designated by the designation 
information received from an application execution management device, from among 
the plurality of predefined operation-plane images (Rafii, col. 4, II. 27-33; projection of a 
grid or image); 

and wherein the operation detector has a plurality of kinds of mutually different 
recognition functions to recognize operation content by at least one of position, direction 
and movement of an operation object on the plurality of predefined operation-plane 
images (Rafii, col. 12, II. 33-47), 

and detects operation on the selected operation-plane image by using the 
designated recognition function designated from among the plurality of kinds of mutually 
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different recognition functions by the designation information received from the 
application execution management device (Rafii, col. 10, II. 27-34). 

Rafii however fails to expressly teach wherein at least part of the selected 
operation-plane image is changed during the operation on the selected operation-plane 
image according to detection of the operation content using the designated recognition 
function. 

Fong discloses a virtual keyboard system, analogous in art with that of Rafii, 
wherein at least part of a selected image-plane image is changed during a operation on 
a selected operation-plane image according to detection of the operation content using 
a designated recognition function (Fong, fig. 3; pg. 2, par. 19). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the operation detection means of Rafii, to include 
wherein at least part of a selected image-plane image is changed during the operation 
on a selected operation-plane image according to detection of the operation content 
using a designated recognition function, as taught by Fong. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide a feedback to a user that a key stroke has been 
entered from the virtual keyboard (Fong, pg. 2, par. 19). 

Rafii as modified by Fong however fails to teach the application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network. 
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Kloba discloses a system for customizing content on a mobile device, analogous 
in art with that of Rafii as modified by Fong, containing application execution 
management means for managing application program execution environment of an 
application program selected from a plurality of application programs that is downloaded 
via a mobile communication network (Kloba, col. 4, II. 37-41; col. 7, II. 5-9; col. 11, II. 15- 
21). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong to include application execution management means for managing application 
program execution environment of an application program selected from a plurality of 
application programs that is downloaded via a mobile communication network, as taught 
by Kloba. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to run multiple applications on a mobile 
device while on-line or off-line (Kloba, col. 1 , II. 36-39). 

Claim 18 is rejected as being dependent on rejected claim 15 as discussed 
above and further, Rafii as modified by Fong and Kloba teaches further comprising: a 
memory that stores the plurality of predefined operating-plane images (Rafii, col. 12, II. 
48-53). 
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Claim 19 is rejected as being dependent on rejected claim 4 as discussed above 
and further, Rafii as modified by Fong and Kloba teaches wherein changing the part of 
the selected operation-plane image includes at least one of: changing a color of the part 
of the selected operation plane image, changing a luminance of the part of the selected 
operation-plane image, and changing the part of the selected operation-plane image 
into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claim 20 is rejected as being dependent on rejected claim 6 as discussed above 
and further, Rafii as modified by Fong and Kloba teaches wherein changing the part of 
the selected operation-plane image includes at least one of: changing a color of the part 
of the selected operation plane image, changing a luminance of the part of the selected 
operation-plane image, and changing the part of the selected operation-plane image 
into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claim 21 is rejected as being dependent on rejected claim 7 as discussed above 
and further, Rafii as modified by Fong and Kloba teaches wherein changing the part of 
the selected operation-plane image includes at least one of: changing a color of the part 
of the selected operation plane image, changing a luminance of the part of the selected 
operation-plane image, and changing the part of the selected operation-plane image 
into a different image (Fong, fig. 3; pg. 2, par. 19). 
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Claim 22 is rejected as being dependent on rejected claim 15 as discussed 
above and further, Rafii as modified by Fong and Kloba teaches wherein changing the 
part of the selected operation-plane image includes at least one of: changing a color of 
the part of the selected operation plane image, changing a luminance of the part of the 
selected operation-plane image, and changing the part of the selected operation-plane 
image into a different image (Fong, fig. 3; pg. 2, par. 19). 

Claims 12, 13, 16 and 17 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rafii et al. (6,614,422) as modified by Fong et al. (US 2005/0012721) 
and Kloba (US 7,263, 547) and further in view of Lieberman (US 2002/0075240). 

Claim 12 is rejected as being dependent on claims 4, 6, or 7 as discussed above 
and further, Rafii as modified by Fong and Kloba fails to teach a mobile communication 
terminal wherein the mobile communication terminal is configured by using a light 
source, a spatial light modulation unit for modulating light output from the light source, 
and an optical system for projection imaging that projects by imaging a light image 
output from the spatial light modulation unit on an external projection screen, the mobile 
communication terminal comprises an optical system for diffused illumination for 
homogenously illuminating by diffusing light output from the light source to an external 
illumination plane, and the light source and the spatial light modulation unit are both 
shared to generate a light image subject to projection and generate a light subject to 
diffused illumination. 
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Lieberman discloses a virtual data entry device, analogous in art with that of Rafii 
as modified by Fong and Kloba, wherein the mobile communication terminal is 
configured by using a light source, a spatial light modulation unit for modulating light 
output from the light source, and an optical system for projection imaging that projects 
by imaging a light image output from the spatial light modulation unit (Lieberman, Fig. 
28; pg. 10, par. 184) on an external projection screen (Lieberman, Fig. 29; pg. 10, par. 
186), 

the mobile communication terminal comprises an optical system for diffused 
illumination (Lieberman, pg. 10, par. 184) for homogenously illuminating by diffusing 
light output from the light source to an external illumination plane (Lieberman, Fig. 28), 

and the light source and the spatial light modulation unit are both shared to 
generate a light image subject to projection and generate a light subject to diffused 
illumination (Lieberman, pg. 6, par. 135; light source is a single laser source). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong and Kloba wherein the mobile communication terminal is configured by using a 
light source, a spatial light modulation unit for modulating light output from the light 
source, and an optical system for projection imaging that projects by imaging a light 
image output from the spatial light modulation unit on an external projection screen, the 
mobile communication terminal comprises an optical system for diffused illumination for 
homogenously illuminating by diffusing light output from the light source to an external 
illumination plane and the light source and the spatial light modulation unit are both 
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shared to generate a light image subject to projection and generate a light subject to 
diffused illumination, as taught by Lieberman. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide an expanded input device for a small sized PDA or 
cell phone (Lieberman, pg. 1, par. 9). 

Claim 13 is rejected as being dependent on rejected claim 12 as discussed 
above and further Rafii as modified by Fong, Kloba and Lieberman teaches a mobile 
communication terminal, the mobile communication terminal comprising (Rafii, Fig. 1A, 
80): 

a camera unit that generates image data by transforming the light image to 
electric signals (Rafii, col. 2, II. 21-36); 

and an optical system for camera imaging for imaging the light image subject to 
shooting on the camera unit (Rafii, col. 2, II. 21-57); 

wherein the operation detection means is configured by using operation object 
detection means for detecting at least one of position, direction, and movement of an 
operation object operating on the operation-plane image and operation detection data 
generation means for generating operation detection data corresponding to position, 
direction or movement of the operation object based on the detection results of the 
operation detection means (Rafii, col. 2, II. 21-57); 

and the camera unit and the optical system for camera imaging are both shared 
as the operation object detection means (Rafii, col. 2, II. 21-57). 
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Claim 16 is rejected as being dependent on rejected claim 15 as discussed 
above and further Rafii as modified by Fong and Kloba fails to teach a mobile 
communication terminal wherein the mobile communication terminal is configured by 
using a light source, a spatial light modulation unit for modulating light output from the 
light source, and an optical system for projection imaging that projects by imaging a light 
image output from the spatial light modulation unit on an external projection screen, the 
mobile communication terminal comprises an optical system for diffused illumination for 
homogenously illuminating by diffusing light output from the light source to an external 
illumination plane, and the light source and the spatial light modulation unit are both 
shared to generate a light image subject to projection and generate a light subject to 
diffused illumination. 

Lieberman discloses a virtual data entry device, analogous in art with that of Rafii 
as modified by Fong and Kloba, wherein the mobile communication terminal is 
configured by using a light source, a spatial light modulation unit for modulating light 
output from the light source, and an optical system for projection imaging that projects 
by imaging a light image output from the spatial light modulation unit (Lieberman, Fig. 
28; pg. 10, par. 184) on an external projection screen (Lieberman, Fig. 29; pg. 10, par. 
186), 

wherein the mobile communication terminal comprises an optical system for 
diffused illumination (Lieberman, pg. 10, par. 184) for homogenously illuminating by 
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diffusing light output from the light source to an external illumination plane (Lieberman, 
Fig. 28), 

and wherein the light source and the spatial light modulation unit are both shared 
to generate a light image subject to projection and generate a light subject to diffused 
illumination (Lieberman, pg. 6, par. 135; light source is a single laser source). 

At the time the invention was made, it would have been obvious to one having 
ordinary skill in the art to modify the mobile communication terminal of Rafii as modified 
by Fong and Kloba wherein the mobile communication terminal is configured by using a 
light source, a spatial light modulation unit for modulating light output from the light 
source, and an optical system for projection imaging that projects by imaging a light 
image output from the spatial light modulation unit on an external projection screen, 
wherein the mobile communication terminal comprises an optical system for diffused 
illumination for homogenously illuminating by diffusing light output from the light source 
to an external illumination plane and wherein the light source and the spatial light 
modulation unit are both shared to generate a light image subject to projection and 
generate a light subject to diffused illumination, as taught by Lieberman. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to provide an expanded input device for a small sized PDA or 
cell phone (Lieberman, pg. 1, par. 9). 

Claim 17 is rejected as being dependent on rejected claim 16 as discussed 
above and further Rafii as modified by Fong, Kloba and Lieberman teaches a mobile 
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communication terminal, the mobile communication terminal comprising (Rafii, Fig. 1A, 
80): 

a camera unit that generates image data by transforming the light image to 
electric signals (Rafii, col. 2, II. 21-36); 

and an optical system for camera imaging for imaging the light image subject to 
shooting on the camera unit (Rafii, col. 2, II. 21-57); 

wherein the operation detector is configured by using an operation object 
detector that detects at least one of position, direction, and movement of an operation 
object operating on the operation-plane image and operation detection data generator 
that generates operation detection data corresponding to position, direction or 
movement of the operation object based on the detection results of the operation object 
detector (Rafii, col. 2, II. 21-57); 

and the camera unit and the optical system for camera imaging are both shared 
as the operation object detector (Rafii, col. 2, II. 21-57). 

Response to Arguments 

Applicant's arguments with respect to claims 4, 6-7, 12-13 and 15-22 have been 
considered but are moot in view of the new ground(s) of rejection. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHARLES HICKS whose telephone number is 571-270- 
7535. The examiner can normally be reached on Monday-Thursday from 7:30 to 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Sumati Lefkowitz, can be reached on 571-272-3638. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

/Sumati Lefkowitz/ 

Supervisory Patent Examiner, Art Unit 2629 



